Improved Hessian approximation with modified secant equations for symmetric rank-one method

نویسندگان

  • Farzin Modarres
  • Malik Abu Hassan
  • Wah June Leong
چکیده

Symmetric rank-one (SR1) is one of the competitive formulas among the quasi-Newton (QN) methods. In this paper, we propose some modified SR1 updates based on the modified secant equations, which use both gradient and function information. Furthermore, to avoid the loss of positive definiteness and zero denominators of the new SR1 updates, we apply a restart procedure to this update. Three new algorithms are given to improve the Hessian approximation with modified secant equations for the SR1 method. Numerical results show that the proposed algorithms are very encouraging and the advantage of the proposed algorithms over the standard SR1 and BFGS updates is clearly observed.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The modified BFGS method with new secant relation ‎for unconstrained optimization problems‎

Using Taylor's series we propose a modified secant relation to get a more accurate approximation of the second curvature of the objective function. Then, based on this modified secant relation we present a new BFGS method for solving unconstrained optimization problems. The proposed method make use of both gradient and function values while the usual secant relation uses only gradient values. U...

متن کامل

A Limited-Memory Multipoint Symmetric Secant Method for Bound Constrained Optimization

A new algorithm for solving smooth large-scale minimization problems with bound constraints is introduced. The way of dealing with active constraints is similar to the one used in some recently introduced quadratic solvers. A limited-memory multipoint symmetric secant method for approximating the Hessian is presented. Positive-definiteness of the Hessian approximation is not enforced. A combina...

متن کامل

On a Geometric Interpretation of the Positive Definite Secant Updates Bfgs and Dfp from the Wedderburn Formula

The BFGS update and the DFP update perhaps are respectively the most successful Hessian and inverse Hessian approximations for unconstrained minimization problems This paper describes a geometric meaning of these updates understood from the Wedderburn rank one reduction formula

متن کامل

Rank Modifications of Semi-definite Matrices with Applications to Secant Updates

The BFGS and DFP updates are perhaps the most successful Hessian and inverse Hessian approximations respectively for unconstrained minimization problems. This paper describes these methods in terms of two successive steps: rank reduction and rank restoration. From rank subtractivity and a powerful spectral result, the first step must necessarily result in a positive semidefinite matrix; and the...

متن کامل

On the stratification of secant varieties of Veronese varieties via symmetric rank

When considering σr(X), the variety of r-secant P r−1 to a projective variety X, one question which arises is what are the possible values of the X-rank of points on σr(X), apart from the generic value r? This geometric problem is of particular relevance (also for Applied Math) when X is a variety parameterizing some kind of tensors. We study here the case when X is a Veronese variety (i.e. the...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • J. Computational Applied Mathematics

دوره 235  شماره 

صفحات  -

تاریخ انتشار 2011